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(57) A television companion device (TCD) is a de- 
vice comprising a communication transceiver capable 
of receiving a signal from a television set, the signal hav- 
ing one or more types of information split from a broad- 
cast signal received by the television set and an output 
that presents one or more segments of one or more of 
the types of information. This device enables the per- 
sonal viewing of information selected specifically for the 
individual. This information can be different than and/or 



unrelated to that displayed on the television. The infor- 
mation displayed cn each individual TCD may be video 
clips or video programs, audio clips or audio programs, 
data, graphical images, still images, and/or animations' 
The device may also comprise an input that sends one 
or more messages through the communication trans- 
ceiver to the television, thereby allowing the viewer to 
send requests for information to the television or send 
messages to other television companion devices. 
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Description 

Field of the Invention 

[0001] This invention relates to the area of digital tel- 
evisions. More specifically, this invention relates to se- 
lecting and accessing different portions of an informa- 
tion stream from a digital television. 



Background of the Invention 



70 



[0002] - Analog television in the United States and 
elsewhere in the world is* one of the most effective 
means of communication and 'entertainment, 'yet it has 
undergone relatively little advancement in recent years 
in comparison to other electronic technologies. Its p'rih- ' 
cipal capability has been to distribute individual chan- 
nels of moving image's aWd'sbund to ^ millions of viewers ^ 
around the world. It has hot; however, exploited the phe- 
nomenal technical advances of the past twenty-five 
years nor the" wealth' of information how available elec-]' \ 
tronically. We are now on the verge, however, of ena- * ! 
bling these advances with the introduction of digital tel- 
evision. : * ' * : - * * " '' /[ " ' ^ ~ [\ f 
[0003] Recently, webTV enabled the browsing of web 
pages and the display of them on a traditional television 
set. The television can be used for web brows i rig/or pro-" 
gram viewing, but cannot be used for both operations 
simultaneously. In : both cases, the viewing Is done in a ^ 
communal manner, i.e. all viewers get the same infor- 
mation. Recently, some broadcasters have coordinated, 
the simultaneous broadcasting of a particular program f 
and the serving of associated information on the inter- 
net. Once again, this is done in a principally communal ~- 
environment. 

[0004] sbon, digital' television will enable the distribu- 
tion of auxiliary information with a videb broadcast With'' 
this technology, a video signai can be digitized, pack- 
etized and multiplexed with one or more audio signals 
and one or more data channels! The data channels can 
.be closely related to the associated* video or rriay'be 
completely unrelated. These multiplexed signals aire re- 
ferred to as a program. Additronally'many programs can . ^ 
be multiplexed into d single Trarisport Stream". The re- 
sulting signal can be distributed to television viewers 
through either a* terrestrial broadcast, a CATV network 
or other network; Once received, the television can'de- 
muttiplex the video^audld and auxiliary information and 
output it on the TVs screen and/or speakers. ' ! 
[0005] Today, selection of the program content to be * 
viewed on a television is accomplished by a channel se- 
lector. It selects the^VHF or UHF channel ^ich'the tel-\ 
evision will tune to and can often be controlled I by a 're- 
mote control device. In this capacity, the selector selects a 
one video signal and one or more channels of audio' In ' 
addition, today s VCRs can be programmedto s/elect a 
particular cha'nnelat a scheduled time in the future, lei- 
evisions do not typically have' this feature. ! " 
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[0006] A television also uses many of the , various 
types of wireless technologies currently available (TV 
remote controls, broadcast signals, etc.). The broadcast, 
signal is an example of a signal modulated to create a 

* radio frequency signal which can be transmitted through 
the air. The television receives and demodulates this 
signal to create the original baseband signal. Television 
remote controls often modulate a signal on an infrared 
light to transmit information through the air. In this case, 
the television receives and demodulates, the signal to 
^create the original baseband signal. Cable TV is an ex- 
ample of signals which have been modulated to a radio, 
frequency and theri transported over a coaxial cable. 
Once again, a television demodulates the signal to cre- 
ate the originarbaseband signal. In some cases,. cable, 

* television.neXwofks/mpdulate a laser or light emitting di- 
ode to transport': the ^signal over a fibre optic cable.. In 
this case, a photo. detector, is. used to. enable the recre- 
ation of the original broadcast signal. . . ? - 
[0007] Originally, a television was defined as a device 
capable of receiving an analog broadcast signal over a 
VHF or UHF channefand selectively displaying one vid^ . 
eo signai together with its associated, audjo signal. To- : 
day, the signal received can. come from a cable TV net- : 
work, a terrestrjal broadcast, a .yideo tape recorder or- 
camera, a compter network or other video source 

the television merges with„qther devices,- such as per- 
sonal computers, it will require an eyen. broader defink 
tion. In this instance, a more appropriate definition is a 
device which receives a signal consisting of onaorjmpre - 
video channels and one or more types "of information 
streams including audio, data, text and. graphics and 
which outputs one pr mqreof, these streams. . . r \ I 
[0008] The;4tgnals, output on, a television today. can- 

. include video, audjp and data, the audio output is typi- - - 
cally amplified by an audio.amplifier and then sent to a ;c 
pair of headpnphes or one or more speakers. The video. , 
is most often displayed oc\ a cathode, ray tube, .but it may - 
also be displayed by a projection system or on a flat pan- 
el! display. Thjis latter technology includes the, relatively. , 

.'new thin-film transistor displays. Text characters are al- , 

. so often oyeriayed on the video to display the time , of - 
'day, selected, channel, closed caption vtext. or other in- 
fqrmationr Typically, .one yideo stream, one text stream 
and multiple audio streams-are, output. r , , ;: 
[0009] Many televisions :today contain, processors ol 
'different types: video processors, digital signal proces- 

' sors, etc. Televisions are beginning to merge with per- 
sonaLcomputers and contain subsystems that look like - , 
PCs. This may include a processor IC, static, ram, dy- ; 
namic ram,., interrupt .handlers. .and other peripheral de-^ 

^vices normally associated with, a computer. Thus,, many. . 

. '. pHhe applications which RCjusers haye enjpyed r will be,.^- 
available in the television system,. including the capabil- ^ 
jty to exchange messagea and play computer games: 
I961 0] Digital television provides tor the'Simultanebus * , 
Broadcast bl both a television program and .associated - ; 

* data. The data can be displayed with or overlayed on 
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the broadcast video. This technology, however, indis- 
criminately forces all viewers to see the same informa- 
tion and only theinformation chosen by the broadcaster. 
Thus, while one viewer of a football game on television 
may be interested in statistics and another viewer is in- 
terested in the scores of other games, both viewers are 
forced to view the same information. In addition, only 
information chosen by the broadcaster may be ac- 
cessed by the viewer. ^ : 
[0011] The Internet, alternatively, provides access to 
vast amounts of information. While Web browsers such 
as WebTV can provide access to this' information, they 
do not provide access to information distributed with the 
video broadcast if that information was ndt obtained 
from the internet/They also provide a principally conv v 
munal viewing experience for the accessed information; 
In other words, all people in the foonf^e^h'^ejy 
see the entire amount of wriformatlort sh^wn 6h tne 
screen whether that information comes from the brb^d- ; 
caster or the Internet. ? ' : " "■ e> O " r 

[0012] Unfortunately/ neither of :th£se '^sterns 'pro- 
vides customized! irrdiviclual Viewing of theSauxifen/ in r 
formation available: The pribr'aff^stems ais& 'ia\\ r i$ 
provide simurtanebus^access ic^Dbfri ^he^cJIc^i^evi-: 
sion broaBcast and the lrtternel c TO^f6f o^e* cef&irY en- ' 
tertainment'&nd economic vSue 6f teleVisibabr^c^st- 
ing is not 'exported byith'e prior a r rt. vr ~"~" "~ i ^ r(v " i * 
[001 3] * |t> is an object of trie present' ihyentioH" to prb-' 
vide a technique wfiich i alleviates the above^drawfiabksy 

Summary of the Invention K ' :ir " ^ v ? 
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[001 4] According to the pre^senf iriventi^ 
a television compahiori device XTCD) CoVnpYiWir^ : ^ ;! 
communication receiver capable of Tedelvihg' a ' sidral 
from a television set; tWe J signal hWng'6ne°6r xti6je' 
types of information ! split from i; i br^ 
ceived by ; the television set r^rid^h output that presents^' 
one or more segments 1 of orWb? 'mote of tr^ t^es 'of : 
information. ; " : ' -\. ' -;■ ^ v" : ~ >-'£'■-"■■■ 

[001 5] Xlsb&ccording to the p res entln vent ion : wepro- " ! " 
vide a television companion device (TCD)"cdrhflrisiny:"'~ 1 
a communication interface capable i of receiving a signal ' " 
from a television set, 'the signa) having one of mors 8 ' ' 
types of information; a selector that selects one or rnore 45 
segments from one or more of the types of information r ,; / 
and an output' that ■ preseftts on^ r or more of the 'seep 
ments. c ^-^r - * 

[0016] A television companibn device (TCD) isa'W- 
vice comprising a commutation transceiver capable' 1 so 
of receivings signal from a televisiorrset, the signal h^v- 
ing one or more types of information split from' a broad- * 
cast signal received bylne' teW^ 

that presents one or more sfegmlhts ol one dr more 'bf : ? } 
the types bPtnfoYmatiorv. Y+iis i: device enables- the "per- &s s 
sonal viewin^of information selefctia specifically for-the ' * 
individual.-Thislhfc^mM^ P 
unrelated to > thaPdjsp^ The inter- : * ' c 



./nation displayed on each individual TCD may be video, 
clips or video programs, audio clips or audio programs, 
data, graphical images, still images, and/or animations! 
The device may also comprise an input that sends one 
or more messages through the communication trans- 
ceiver to the television, thereby allowing the yiewer to 
send requests for information, to the television or send 
messages to other television companion devices. 

Brief Description of the Drawings 

, [0017] ^The foregoing and other objects, aspects and 
„ ; advantages will be better understood from the following 

detailed description of preferred embodiments of the in- 
. vention with .reference to the drawings that .are include 

the following: '.' ' _, V. - , ., .'./. "! 

F '9 u J e € 1.X^ ^ipck, digram p1 an jmprpve^ televi-^ 
, ^ sion . gyst^nit using ^ teleyisipn companion device; ( . 

F '9 u /f A '5 $M°?k diagram of an improved -tejeyi- 

J.! sion;.*/ v .,*!,/^ ! r ; ! 'Z~\ A ~ \ . 

rr- -'^^'-c «c ^.'rs.^w sir i.> - 
Figure 3 is a block diagram of a preferred television 

:ha; companion g^yice;. rj . • ^ , 0 . , . - - ^ - : 

. , I Figufg^l is a block diagram of 3 Prof He. ^bsystemj . 

: U Fi9u ^ e 5'f : $ flow^charf of a seJeption process; .and. r 

Z. Figure 6 is^an^ a profile configured. with ' 

" \ profile iterrjs, 1 . L," _/[ \ . 



^1 .C^etaiied Descfi'ptioh of the Invention ! , ; 

, [001 8] With the. advent of.digitai television, broadcast-i 
: er;s will nojong^r be ^limited to. broadcast in a a single pro- 
gram of video and aUdjp^ they will soon haye the ability . 
tq transmit multiple prpgrarris of audio, . video, data and 
w he U^ tpraprtalize on these- 

jiew capa^Tlitiei a new television -system is.needed to 
facilitate the viewing pf this Jnformat ion, 
" , K'01 9] Figure! 1 is a bl^^diagrarri of a novel television 
system 10f with.^bu^ embodiments of the television 
. companion ^deyice i (XpD) 120. In this system 101, the. 
wt© fev >sion 1 do presents. content to. the general viewing 
^ audience 65 and cpnrlipuhicates wfth\a number of tele-, 
^vision companion devices 120 ; via a communication link 
_ (109, 121). In one preferred e^mbopjiment, theTCDs 120 
" are handheja^devices used to^resent individual, cus- 
tomized information to viewers. In alternative embodir 
rrients, e.g. in a. teleconferencing pom or in a^bar, the,, 
, TCDs 120 can be mounted .into" a terminate.gla table 
,* or desk, provided to eVch viewer 65.. the goal here is to 
L. identify, select and view ; information streams of interest ~ 
^to. the general; viewing aucjience 65 (television) and for 
. each individual gS (hplder/user of a TCD), This will help 
; the viewers (e.g! multiple; numbers of 65.) find and view \ 
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the streams which have the highest entertainment or in- 
formational value to both the general audience 65s and 
the individual viewer 65. 

[0020] The information streams- 185 are audio (e.g., 
English and/or Spanish commentary of a soccer game), s 
video (e.g., the moving images of the soccer game), da- 
ta (e.g. statistics on the players), graphic (e.g. graphs 
of the statistics), still image (e.g., portraits of the players) 
or animation streams (e.g. computer generated videos 
diagramming and explaining a play in the game) broad- to- 
cast over a television network. In a preferred embodi- 
ment, these-information streams, or streams, : typically 
185, comprise a plurality of byte packets, typically i 88' 
as specified in the. MPEG-2 -specifications In a preferred ' : - 
embodiment, they:are time multiplexed together to ere- -is- 
ate a Program Streamrtypjcally 186: One or more Pro- v ~ 
gram Streams. 1 8S can then be multiplexed *togethe7to iV " 
create a Transport Stream (TS) 191 that is : transmiftefl' 5L '' 
from the broadcaster, (A^weii known Program Identifier c 
(PID) is used to^ident if y each of the i information streams 1 ^ ~20- 
1 85 within the' TS 1 9T:^lrf-Diglal Tetevis^jbn/trte TranV- 1 : ~ 
port Stream 1.91 is broadcast- to4he viewer 65 on a VHF 1 ^ f " 
or UHF channel.^- : " r ^ ^ ' :C: *~ r ^""^ ^ 
[0021 ] As: stated ab6ve;-some"6f : 'the important' oper- ' : A ' 
ations are. the identificatlon^se lection arid presentation^ r 25 - 
of the information streams 1 85' "to 'the" audience (65s). r 
Although the television 100 must perform the selection 
for the general viewirig'audiehce 65s^ thestreams of in- «> [ 
terest 1 85 tq:the "individual vlewers-65-can be sel^ctecl '" ~ 
by the television f 00 and/or the TCDsTi 20. As described " 36 
below, theiselectibri process can b#executed automat- ' [ 
ically or can require-'manuaT ; interventioh by the- viewer J 1 
65. Once selected, the stfeams~ : 1 85 for the general view- : " 
ing audience-65s are output on the television 100: The' 
streams 1 85-selected for the ihdivid ual Vi ewers 65s ar6' ss 
transmitted by the television 1 0O'tb the TCDs 1 20 where " 
they are output on aTCD output (125-^7), e.g.' ah op- ' 
tional display device (126-127) and/or output oh an o^-'- 
tional audio device (125). - f z ^' : - r -' ■ — 
[0022] The information streams -185 which are to be 'fo 
output on either the television TOO or TCD'l 20 ; rriust first' ' * : 
be identified and selected. A preferred embodimehf of ['/' 
this system includes a novel Selector (f04 and 124 be- w ' ;\ 
low) which provides fof the : intelligent Selection 'of * * 
streams 185 for a television TOOand/orTCDs T20. Since ;; f 4S"' 
either the television TOO and/or the' 'TCD 120 may per- ';*"* 
form the selection, the selector (104/124) can be usee* 1 J 
in either or both devices (100/120). in one preferred enrF 
bodiment, the television 100 and the 1 TCD 120 contain; 
a selector (104/1 24): Thus, the television TOO has the yo c 
option of broadcasting all received streams 185 td all ~' L \ 
the TCDs 120ya subset of -the streams' ; 185 to all the ^ / 
TCDs 120, a- subset of the streams 185* to a subset of ' ; 
the TCDs 120, or»only selected streams of interest 185 V '^ J 
to particular TCDs 120. In one preferred embodiment,' ss^ 
e.g. during a-particular'time of day, only the' TV Selector ; 
104 selects the selected = streams 185 -and selects' the v x 
subset of TCDs f 20 to receive these" selected streams. * 



For instance, using this embodiment, a parent could limit 
information (stream 1B5) access by a child using the 
TCD 120. In; an alternative embodiment, the TV 100 
sends all streams 185 to all TCDs 120, Here only' the 
TCD 120 Selector 124 selects streams of interest 185 
to display to each particular user 65 on the respective 
TCD output (125-1 27). One application* for this embod- 
iment would be a public setting, e.g. a bar, with a large 
' number of TCD users 65, each interested in specific sta- . 
tistics selected from a large number .of .statistical . 
streams 185 about one "or more games being viewed 
communally on the tV 100. In still another preferred em- 
bodiment, both the TV 1 00 and one or more of the TCDs 
' 1 20. does the selection. In thjs case, the *TV selects sub- . 
sets of streams ]&5 to transmit to one or more subsets, 
of TCDs 120. Then the TCDs 120 will perform an addi- 
tional selection of the incoming streams 185 to selec} 
jthe exact stre^ms^ of inter esUor eabh particular viewer 
"65. In this ^ erf^bqdiment, the TV, 100 selects basketball , 
r game streams 185 and baseball game .streams 185 
from all the ! sports streams X8§ feceived.by the TV ,1 00. 
Then each indiyiduaj TCD'1"20 user .65 selects which of ^ 
the basketfrall/baseballgames and/Pi; statistics he wish- 
_ esto view. ^ y. . . ■;■ ,~ j0 , v , ~ .- ? 
' [0023] The icommun icat'ion link between the television - 
100 and the TCD "i'20, can utilize a number of different 
' technologies.ln some implementations cif the improved 
J teievision>ystem, the TV Transmitter 108 andTCD Re-> 
r ceiver 128 (the i communication j in k^ 
; quency transmitters and receivers (with respective TV 
"antenna 1 09' and f CD antenna 121), fibre optic trans- 
mitters and receivers or .coaxial drivers and^receivers. r 
'Jh the fornSercase, t'tie sjgnaj^wii ('be transmitted through 
the air as inJhexase of the. radio. frequency broadcast 
'described aboye.Jn'the latter cases,, eitheri a fibre optjc 
or coaxiafcabfe "will transport the Co'mm Signal 140 from 
"the Television 100 to th e.TCD. 1 2Q. ^ Jhese ^technologies 
are well knowa '] "\. .... . 

[0024] Figure ^is a block diagram of the novel TV 1 00 
and Figure^3ls a'block diagram of the Television Com- 
: pahion Deyice"(TCP) 120 showing more. detail. The^TV 
1 00 contains a known Broadcast Antenna 1 01 used to 
^receive a known terrestrialBrqadcast Signal .1 50. 1 n one 
(3 referred embodiment, the Broadcast Signal 150 is a 
digital signal, which has. been RF modulated using a 
' known 8 VestigiaLSide Band r (VSB) modulator and then 
"transmitted Tin the $ Ivlhz bandwidth of- a traditional VHF , 
' or UHF chahnel/Typjcatly,' each VHF or UHF channel - 
: will contain one digital signal, of up to approximately 20 
' Mbps. In an ajtemative. embodiment, there is no^anten- 
ha; ! the signaTjs/eceivedover.a coaxial cable or other, i 
^tV^nsmission iechholbgy" This digital signal comprises 
^different types .of timermultipLexedJnfprmation streams 
'185 incJudinlg^any. one or more of the following: pne or 
more video^streams, one or.more audio strearns (chan-y 
rieis) and one 01 mpre^data .j strearris4channels)^Each 
pf these types of streams 1 85' can.be further divided into : 
segments (see Figure 4) where each segment compris- 



4 



EP 0 952 734 A2. 



S 



a vS, e Sor 9 D ™Sm i ° f r ^ °' f0 " OWin9: ; an ana '° 9 Video s « ean ^ easily displayed 
a video clip or program, an audio clip or program and a . using known video output devices. The TV Screen 107 

Tn ^Z^^! TT^ 6 ^^ 6 mUl ' C3n be 3 CRT ' a flat P-n* * projectbnTp ay 

t plexed togethertocreatethe digital signal 102A. These a thin film transistor (TFT) panel or any other type of 

S^^^«•T^^^? ,a ^• A, ^ optionally sent to the known TV Audio Output 105 to be 
^'n^^^S!^^^^^ output on TV speakers or headphones. The TVfieceiv> 

lafZZT ♦ f ° r,9inal ^ roadcast di 9" . ~- . Pr 102, TV Demultiplexer 103. TV AudioOutput 105 TV 

ital signal comprising t,me;multiplexed video streams.. . . Video Output 106. and TV Screen 107 are well known 

e^^TT^f^^ ^ TheWSelectorlOAnseifis-usedinanewTy 
^ ] ec e ^eMp2w,nbecapableof demod-. , ,o provide selected- streams and/or. segments t09Alo 
S to T » 'T' a " OWin9 the T ?^ ision . - «"e TV 1PQ and/orthe TCDs 120. The felector10 4 J£ 

™ difirtr 0 ^' f *v C< v ^^demu.tjp.exed^^ 

from drfferent broadcast channels. The TV Demultiplex,, .. TV Demuftiplexor .103 oh separate vyell-khowTdate' 
or 103 will demuttiplex the video., audio! ^ritf data: ^ busses, ^e streams 185 a^rec^ v ^le^oT 
streams .185 from me 8iB^i;i<^> t q>xd^i.ai;; ..-j04tM bai^ed^the^W P^^^tt^S 
segments of video, audtoand/or data 1 09a; im 

demultiplex the transport streams. 191 .into. a. small -185 are selected by a TV Profile Subsystem- liQrtae-* 

SJJ f £W , . rnformation.. ? treams,4Q9A to me ^-Multiplexor 113-for 
s ream 185js audio videppT ^ 

«r^?M« ? ? 3 lar9e nUmbSr ^wn^udl 9 .C^.ip % a^ 1 i,t^Ty.Videe©ut^ 

f^^f^^^^A^.^^^^ f?o^06forout>,u^the^ 

Luozej Once demultiplexed, the TV Selector 104 if ; low 

used, will then select one df more st^s) ; l|sW^ j; .^[poao] J^tS Multiplexors wU^multiplex^he Be- 
optionally^tputonme-WlOOits^ 

1 IS Z T? ^ ^PM . ^ ^2 1» iniorrnaSoastreams WK^SScS"- 

tionoutpirt, e:g.; Antenna tQd. The TV Selec^ TpAjs " ir^transmittedtot^TCDs^d. The Transport-Streak 19^- 
a specialized device ^^^.•■'^^^K«PV J .> a well k^wnto^'andican b^founcHn ttie MPEG- - 

^F'T^S^ 1 ^/**** t^^lTY-OK ^ . .'ffJP W fvluitiplexor .113 noveUy. appends- an tZ» 
t™ below" The ^^^°^^^^V: c^der fi^d to the ^^P^e^.^^S, 

Wpl e ^? T 5 T8 ^ are ; eC " i ^'' th « 6b ^; i ;-: • ^- on-e: P ref^ed\e^bo di menCe a ch TCD is as* ' 
^77 ^ ^^.^^ ^.^; , - signed an address that is used to determhe which of 
185 to locate importa-nt informatioh s^^^^ «5 packe1s.188are.to.be received ^Zbl head2 

played by the-TV Processor 1 12 on the'TV ScreenW;; ;r^t byte is.theaddres S of theTCD IK I and the second 

s1re^1 V 8^c?me^ ^^'^^^ ^ ^ - a Mpear Redundancy Check^T^^S " 
streams 185 ^ which they rnay choose td sel^t. T^fe TV 1 ; . , well knownTipdlis used.to'dete^t bit errors which mav 

rr h T or H 2 , wi,i f nerate ^ n - ps ^ ich th ? 

TCD Screed 27 "Jf ft? ^ ^ <**J* W ^ ' demu.tip,ex.aod ^pu,.-the packet 

TCD fcZln IS T Tw e o- U " ^ b6 d ' Sblay ^ d ° d - <* Packetmatches the address assigned. to 

m^nulrthe rJSvS 127 >" ^ > theTCD 120. laanaternativeembodiment, theaddress 

^ m r 8 ^' 134 ' Thls - s "f nd .PP^?tioh . , ,1 S inserted, in'ihe user fields defined "in the MPEG-J 
1^ ca b^ l 6 d toS-^ db '^ P.rtransport Specification and is utilized inthe same way 

Ze^s^ ? ?-f^? ? ^ m ' nt - 6 — — • ^^.^ Amative embodiment, the DemultiplexoM23de 

XJSSfflS^ '^another alternative embodiment, the P.D of 

IC is used to ^decompress he vjdeo stream ahdereate ; .. ;:tcp(s) 120sbou;id..receivi StreTtet • 
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If the stream 1B5 was selected by the TV 100 tor a par- 
ticular TCD 120, then the TV Processor 112 will send a 
message to the (TCD) Processor 1 34 containing the PI D 
of the streams 1 85 which the TCD 1 20 should receive. • 
The Processor 1 34 will then instruct the Selector 124 to s 
select the stream 185 which has that particular PID. If 
the stream 185 was selected by the TCD 120, then the 
Processor 1 34 will instruct the Selector 1 24 to select the 
stream 185;which has that particular PID. 
[0032] These streams/segments 1 09A which are des- 16 
tined for the TCDs 1 20 will be broadcast via the known 
TV Transmitter 108 througrvthe known TV output, e.g. ' 
Antenna 109. lasome implementations of the improved 
television system 1 01 , the TV Transmitter '1 08 and TCD * " " 
Receiver 128 will be' infrared transmitters and receivers,- 15 
fibre optic-transmitters and'recetvers or coaxia Id rivers^ 
and receivers.' In the - forme V'oeise? the signal will 'be';' 
transmitted-throu'gh. the airasln- the- case of the radio 
frequency broadcast.described above: (n the latter cas- r "~ 
es, either a fibre optic or coaxial cable wi I ^transport the 
Communication (Comm)*SignaT1^fr6m theTeYevisibh ~ 
1 00 to theTCD' 1 20: In some implement'atibhs; bWrrec- - 
tional communications* is "heeded "between the TV 100" 
and the TCD 120. In this case; the TV 100 willbompriie 1 : 
a TV TCD Receiver 11 4 and theTCD 1 20^will comprise - 
a Transmitter 1 35 utilizing -any known communication 
technology, e. g. one of the technologies outlined above/' 
[0033] In one embodiment, each stream or segment 
1 09 A transmitted in this manner will contaiaan address^ 
290 which identifies the TCD(s) 120 which' it is destined 
for. The address:290 can identify all of the TCDs 120 fn; 
the system, a subset qrthem or a~particular TCD 1 20/ 
If the transmission does not include- an address 290," 
then the Television 100 will broadcast -the information " 
streams 185 to all the TCDs -120. ~ I h on e~ preferred em- 
bodiment, the television 100 will not be able to select 
streams 185 for individual TCDsT20.The TCDs 1 r 20 will ' 
have to either output all the information streams 185 
transmitted by the television or it will have to use-its own " 
Selector 1 24 to select the streams 1 85 which will be out-'' 
put. In alternative embodiments- the PID of thelnforma-* 
tion stream :1 85 can be used to identify streams - 185 
which the TV 100 has selected for the TCD 120. 
[0034] Each TCD 120 will utilize its known; Antenna' 
121 to receive the Comm Signal T4C which is 'transmit- 
ted from the TV 100. The received signal 140 will be ' 
demodulated by the ReceiveM28to recreate the frans- ' 
port Stream 191 transmitted frbrrvthe TV 100; In some' * 
embodiments where the signal is not modulated (e!g. : 
some coax link technologies), the signal does not have 
to be demodulated by the Receiver 128." A (TCD)'De- 
muItiplexor.123-will demultiplex the received signal "intb ; v 
individual video, audio and/or data streams and/or seg- 
ments 123A. In some embodiments, the-Demultiplexor 
123 is a novel demultiplexer which can'utilize the Ad- 1 ;55 
dress Header described above to determine if the hrifor : ' 
mation stream 185 transmitted A rbm the TV 100 should , 
be received by the-TCD -120. It does this by comparing " '~ 
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its assigned Address to the Address in the Address 
Header which is appended to each packet .188 in the 
Transport Stream 191. 

[0035] Once demultiplexed, the (TCD) Selector 124 
will select which streams 185 will be output by the de- 
vice. The selected data and video streams 124A will be 
sent to a (TCD) output, e.g. a Video Output 1 26 for dis- 
play on a (TCD) Screen 1 27. The (TCD) Screen 1 27 can 
be a CRT, a flat panel display, a thin film transistor (TFT) 
panel or any type, of graphical display. The selected au- 
dio channel(s) 124A also will.be sent to a TCD output, 
e.g. the Audio Output 125 to be output on headphones . 
or speakers and/or the .Video Output. 126 after passing 
Through" a* speech recognition system. As described 
above, these are known, devices. Note that in alternative 
^embodiments, one or more of the. JCDs 1 20 would have 
only an audio output 125, e,g. ff a first set of TCD .120- 
users 65 receiyes*audio in a first language -while a sec- 
ond set off CD" 1 20 users 65 watching the same TV.1 00 
display receives audio in a second language. In another 
'altematrve^embobiment,. one or. more of the TCDs 120- 
" would only have' a e.g.. where the 
/f CD 1 20^users j>5 are bnjyjnterested in text information 
that, supplements '[ anS/bf au gments the TV J 00 video- 
' that is common to all the TCtf. 120 users 65. lf 
' [0036] The Selector 1 24 enables each indiyiduaj user 
"65 of a TCD 1 20Yo select parts and subparts ; (segments) 
* :; of information streams (transport stream, streams, and/ 
or segme'nt) 185 transmitted by the Television -100. Se- 
lection of the. streams (segments) (109 A and/or 124A) ; 
to be output by trie TCD 1 20, is performed by the^Se lector * 
^124 and/or the TV.selector 104,.which.can be controlled 
' s in' many alternative ways'. Fpr example, a Menu- Pointer 
T30 can be used to, select an itejn.from a menu which 
appears on ejtherjhe TV Screen i.07 or the TCC} Screen 
1 27. As de'scVibed above, the W Processor 11 2 will gen- 
; 'erate men us, with the/hames of varjpus streams which : 
the user 65, can choose from. Once, selected, the TCD 
Processor 134. wilMnstruct the Selector 124 to output 
- the selected stream(s) J 85. 'Alternatively, a message 
' can be sent from theTCD Processor 1 34 via the Trans-,, 
mitter 1 28"to trie TV i OOjnstructing the TV Seiector.1.04 
to select a'particular stream (s). 109 A for the TCD 120. 
[0037] The.bptjbharkeyboard 129 can also be used 
to identify a stream 1 85 tp.be-outpiit. The viewer 65 sim- 
*^ ply enters the name'qf the stream 185.. As in the. case 
" of the Menu Pointer t30 f the" TCDjI 20. and/or the TV 
.100 will execute the selection 1 24 of the streams/seg- 
ments., \\ , . r . . - - - — 

" [0038] Finally, an optjonaLProfile Subsystem 1 31 and/ 
' br an optionalTV.Rrbfile Subsystem 1 10 can beconfig-*, 
'ure'd to us'e the selector (124 and/or 104) : to. seject 
' streams of .interest 185 Jo the.viewer/65. In ; this case, 
; the !Selecto/ : 1_24*(ty Selector J be automatically; 

^ directed by the Profile Subsystem. 131 .(TV Profile Sub- 
system llOftdgbtajn" these. st^earrvs 185. _ . . - - 
"[0Q39] In one preferred embodiment, the Selector 1 
Ttd4, 124) is controlled by a Profile Subsystem 131 (TV 
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Profile Subsystem 110) which contains information of in- 
terest to the viewer 65. This information can include 
broad categories of interest (News, sports,, weather), 
types of information (statistics, scores, financial) pr.spe- 
cific information (person, place,.. things). Jf\e informa- s 
tion, formally known as Profile Items (typically 605 be- 
low), is stored in a Profile Database 220. See Figure 4 
below. Each Profile Item 605 contains a category, a key- 7 
word, and/or keyphrase which is compareci to Identifiers 
(201 A, 202A, and 203A in Figure 4 below) which identify . w 
the received streams 185. Identifiers (201A, 2Q2A, and " 
203A) can be keywords or keyph rases wrthin the infor- " ,* 
mation data streams 185 or can be generated by the' 
Information Processor (111 and/or ia^ydescribed W- ! 

[0040] Figure 6 shows an'example of a Profile 600 in 
a Profile Subsystem (110 and/or 134),Jn this e~mbodi- 1 
ment, the Profile '600 is a database of a plurality oiJ * 
records, typically 605, each containing a category^ field " * " 
615, a Type field 620, arid one or more fields' with key- '20 
words and/or phrases 630! In this example; the general * '"' r 
audience (television viewers) 65s are interested in any 
stream 185 of information related to Fires (eritry TV 4). ^ 
In the category of sports, the* users 65s' a're inferes^ed^ ' J 
in information on any sports peVsoK'named'^ipp^ 
try TV 1) 630, any hockey scores (entry TV'2)'6^8 and ^ I 
any football scores 630 of the Atlanta team(s) (ehtry TV „. " * * u 
3)630. The viewer of TCD 120 #1 is interested ih world 1 
news 61 5-fo'r Washington; DC 630 and Iraq 630 (entries ' 0 * " 
TCD 1 -3 arid TCD i-2) and any political news on "Clintph 36 ' 
630 (entry TCD V1). The viewer of TCD l&f l£ i^ in- 
terested in jahy events related ^ tS festivals ; 62^ ! (entr^ : ? 
TC D ]-4) ; any weather 6 1 5 forecast $2a fbF'New Vbrk 
630 (entry TCD 12-1) and any Infbi^ktim Wia'to^ v 
nance 615 (entry TCD 12-2). Iri' this e?n^lmenCan^ 'as 
combination of fields can be us'ed W identify an area oP ' ' 
interest. A Boolean ANb^Bratidn is pWrtorrrietfon inV 
profile items 605 1 when : mprV than one field (6 1 5^$ " " 
630) has an entry. ^As streams r T85 aVe Receive^ 
and Demultiplexed 1 23, the Profile Subsystem 13f and/ ^ 
or TV Profile Subsystem 'l 10 wilt search for'mafches be^^ ? 
tween the^received infofmatioh 5 'streams; 186'^ '''' 
profile items : 605 in the Profile database 220. The TV^ U 
Profile Database 220contains Profiles 600 for the TV. '* ' " 
1 00 itself and, optionally, : f or one*' brmore o ; f the TCDs 4S 
120. The profiles 600 for the TV TOO cbmprlses -prbfile * 
items 605 of -Inte rest to" the 3 general television viewing " 
audience 65. The profHes 600 for trie TCDs comprise' ~" 
profile items 605 of interest to each' of the individual'" 
viewers 65 in the system. In addition, profile items 605, so 
for a group "of individual' viewers 65s' can be described. ! * 
The Profile Item Comparator 221 Will perform the actual " 
comparison's described below. - - x 

[0041] In one preferred embodiment/ a match of all ' : 
fields ( 615/620,- and 630) in the prof lie "iterrt 6*05 ha^sto^^s^ 
occur beforc-there is a match: When' a match is found ' ^ ' 
the selector (104 and/or 1 '24) will be instructed tb'seiect 
the identified streani(s) or" segments) 1(i69A 7: a^d/or 



124A) by using the PID to identify the stream 185 --As 
described above, the TV 100 will transmit the selected 
stream(s) and/or segments 109A to the appropriate 
TCDs 120. In some embodiments, the TCD 120 -will 
comprise a Profile Subsystem 1 31 which is the same as 
the TV Profile Subsystem 1 1 0 but which contains a pro- 
file 600 -for the TCD 120 only. 

[0042] f The optional TV Information Processor 1T1 will 
process the incoming video, audio and/or data streams 
185 in sea/ch of information relevant to the viewers. For 
instance, image processing, can be used to Identify a 
highlight of, a football game. If a viewer .we re interested 
in such ; an event, the TV Profile Subsystem would, be 
configured tojndlcaje; this; When the TV Information: 
Pracessor,11.t identified, the event, it. would output' an > 
. identifier (20lA, 2a2A, ( 203A> wfi.ich; willobe compared 
,,.by the P^ofileJtem^Gomparato^^^to erofile Items 605 - 
, in the Prof|!e T Qatal^^^ Pro . . 

...file Item Comparator -221 wfULc_au§e therl^ Se1ector104 ■ 
; to choose,^, approp riate, , stxeani(s) A 85 -anch transmit 
.them to $e.3pprqpEia^ 
0 ..the TCD l^wouj^^^ for ;; 

the viewef. 65, Afternatiyejy, tr^Lrifgrrnatiort Processor - 
p 132 lTOa ^*^^ e :iIPft>2Chcarl; prepes^-the incoming 

stream(s) ,185 and>ider«ify,sUeaf^(s>of interests 85"ta . 
c #»s partiQular : viewer,6§. -lathis case; theSelector 124 
^would bejnstructed to seiectthe.apprppriate.«tream(s) 

i? 043 ! Jh e ty. Information Processor 111 and Infor- ^: 
.mation Processor ,13^6an, utilize varipo?. technologies. 
*° Process and jdentify^treams of,jateresn : 85: to the 
. f yiewers 6g. this, is-s^own in ; Figure-4. ,The Image Proc- 
,; e^ssor 202 ^an^e. used ^tp,identify.aperson,,place, thing,- 
..action, or.eyent.whicbi cari b$ ^ compared to the profile . 
3 : ^ms §05 in the profiles 600. Forexample-; the IBM Oue- 
. ry by Image.Cpntent technology can identify a particular 
^colour or texture in an injage. Similarly, the Audio Proc- 
_essor 201cWill r use speech, recognition to generate a 
^.searchable^traAscriptl searching, audio 

processing.tq determine the type ; pf audio including any 
,oae or more of the, following: speech, music, noise and 
. .jsqunds aad speaker identification processing to deter- 
mine the identity of a particular speaker. IBM^s Via Voice 
product, for instance, can generate^text from the spoken 
word,- Finally, the : Text Processor , 203 can be used to ■ 
reduce the incoming d^ta information into a searchable 
hit, list of one or more words. The Identifiers (201 A, 
20'2A, 203A) generated by these^ processors (201 , 202,' ■ 1 
.203) are sent to thePrpfile Item Comparator 221 to be , 
Compared to items in -the, Profile, Database 220 Each- 
Identifier (201 A, 202A t 203A) is compared to each entry - 
ip.the profile 600. If all- the- entries in a record.805 are 
found in the. set ot'ldentifiers (201 A, 202A, 203A) gen- - 
; elated for a ( fjarticuiar Inforjnatipn Stream 1 85, then tha: " 
.|[nf t prmaJion v Stre^m.185 is selected ; and sent to the TV 
t 'ipp or TCD. 120 identified in- the label pf the. entry; 605.; ■ , 
.A 'match in this comparison, will result in an output on the' 
^elector Cgntrpl 231. signal wh ich will instruct \t\e-JV Se-> 
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lector 104 or Selector 124 to select- the appropriate 
stream(s) 185. In an alternative embodiment, the Infor- 
mation Stream 185 will be selected if a subset of the 
Identifiers (201 A; 202A, 203A) for the Information 
Stream 1 85 matches any arbitrary subset of the fields ( 
615, 620, and 630) in the profile item 605. The technol- 
ogies utilized in, the TV Information Processor 111 are 
all known. - - 

[0044] As an example of the improved television sys- 
tem 101, assume three television stations are broad- 
casting on different VHF channels: channels 3, 4 and 9. 
In this scenario, channel 3 is broadcasting a football 
game complete with highlights (NFL) and scores from 
other games in a data stream (SCORES). It is also trans- 
mitting news updates on a separate data channel 
(NEWSUP). Channel 4 is broadcasting a hews program 
(NEWS), a news magazine show (NEWSMAG) arid a 
documentary on U. S. Presidents (DOC). Channel 9 is 
broadcasting a movie in high-definition format (MOVIE); 
The profile 600.-is configured as in the example : abbveY 
There are two TCDs.1 20 • receiving^ roadcasts from 1 a 
television -100; Each. TCD 120 has all of the optional' 
components described above. Figure 5 js- ^flowchart of 
the processes which occur in the improved television 
system 101 ' . " r ; ''- ' - . - 

[0045] Figure 5 is a f low chart ."of one preferred selec- 
tion process 500 that is used to performed by the system 
101. This process 500 is now explained by way "of Ex- 
ample. As the broadcasts are received, the TV Receiver 
102 demodulates SOT the three broadcast signals to rec- 
reate the original digital Transport Stream signals 0 ! 91^. 
The TV Demultiplexer 103 will then demultiplex 502 the : 
signals to recreate the following information streams: 
NFL, SCORES, NEWSUP, NEWS, NEWSMAG, DOC, 
and MOVIE. All of these streams 185 will be sent to the 
Selector 104 for, selection 503. Simultaneously, the TV 
Information Processor 111 is processing 512 each of-the- 
incoming streams 185 and creating identifiers (201 A, 
202 A, 203A) which are used by tha Profile Comparator 
221 to determine 51 3 which streams 185 are to be out- 
put (105, 106, 125, and 126). These items are 'sent tcP 
the TV Profile Subsystem 110 for-tise in the selection 
process. The TV Processor 112 is also parsing 510Tthe 
data streams 185 to : search for categories 615, typ 1 es : 
620, and/or keywords and keyphrases 630 which are 
indicative of the content of each information stream 1 85" " 
In addition-, the TV Processor 1-12 will also create menus 
511 of the categories 615, types 620, and/or keywords' 
and keyphrases 630 identified and will display them on 
the Television 100' and TCDs 120 ! to allow the viewers 
to select streams of interest 1 09A and 1 24A. - "y 
[0046] In this example, the TV Information Processor 
111 has generated the Identifier (201 A, 202A, 203A) 
FIRE from the news program (NEWS) after it has gerT- 
erated the • Identifier (20 1A, : 202 A,- 203 A) ATLANTA 
FOOTBALL from the NFL program (NFL). The WProc-^ 
essor 112 has -also discovered the -Identifier (20 TA, : 
202A, 203A) 1 CLINTON in the documentary program 
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(DOC) and the Identifiers (201 A, 202A, 203A) EVENTS 
FESTIVAL from the movie program (MOVIE). All of 
these Identifiers (201 A, 202A, 203A) keywords are sent 
to the TV Profile Item Comparator 221 . 
[0047] ' The TV Profile Subsystem 110 is continuously 
comparihg the received Identifiers (201 A, 202A/203A) 
to the profile items 6051n the TV Profile Database 220. 
After finding a match between the Identifier (201 A, 
202A, 203A) ATLANTA FOOTBALL and Profile 600 en- 
try TV 3 (620; 630)', the TV Profile Subsystem 110 will 
instruct the TV Selector 104 to select 503 the football 
program (NFL)' for the TV 100.. Later, when the FIRE . 
Identifier (201 A, 202A, 203A) is generated, the TV Proc- 
essor 112 will generate a menu 51T tp'be displayed.on " 
the TV Screen 107* This will alert the TV 100 viewers 
that a fire is being referred' to on the J news program 
(N E WS) 'and will allow them to switch to this program! 
In addition, the TV Profile Subsystem 110 will instruct 
the TV Selector : *i 04 to "select 503 the documentary 
(DOC) for f CD 1 20 ; #1 and tti.e movie (MOVI E) on chan-' ' 
nel 4 for TCD 120_#12. The" ^ streams 'selected for the 
TCDs 126' are^senrtb the W/Mu.ltipl^^ 
addresses' of each of the'TCDs 1 20 are appended to the* 
streams. The TV Multiplexor'iV6 wili multiplex 504 these , 
•streams destined for the TCDs 120 together with the 
menus generated 511 by the TV Processor 112. The 
Transport Stream 1 91 which is generated is then trans- . 
mitted 505 to the TCDs 120 via the TV Transmitter 108 
and the TV Antenna 109. _ _ . . r 

[0048] As described previously/the TCDs 1 1 20 wiM re- 
ceive 506 the Comm Signal 140 via the. Antenna. 121 
and will demodulate 506 the'signal to create the original. 
Transport Stream* tsH /'the pemu|tiplexor 123 will de,-. 
multiplex 507 the Transport Stream 140 into the indiyid-. 
'ual iriformafioW st reams '135 ' arid will compare the ad- 
dress of each stream with the address of the TCD 120. 
When a match is'fbuhtl, the Derriulti plexor 123 will. for- 
ward the stream to the Selector 124. The Selectors 124 
in TCDs 120 #1 and #12 will send the selected 508 in- 
formation stream^s) 185 to the appropriate device (125, 
126) for output 509. Additionally,, the Information Proc- 
essor 1 32 and Processor 1 34 in the TCD 120 may also 
generate 515 Identifiers (201 A, 202A, 203A) on the in- ., 
formation streams 185 received from theTV 100. Sim- 
ilar to the operation described above, the Profile Sub- . 
system 1 31 Will compWe c lderitifiers '(201 A, 262 A, 203A) ^ 
and will instruct 516 the Selector 124 to select 508 one. 
or more of the information streams 185 for output 509 
on the TCD 1 20 if a stream(s) 1 85 of interest to the view- , t 
eY 65 have been found. . 
[0049] Other capabilities enabled by the. improved tel- 1 
evision system' include the ability to exchange informa- 
tipn between TCDs 120. In this case, messages typed 
on the Keyboard 1 29 will be input to the Processor 1 34, „ 
The Processor 1 34' will format the message, 'embed the 
address of 'theTCD(s) '120 which, sho,^ ,. 
} message and transmit the'message via the transmitter 
' 128. This will allow individuals 65 viewing a television 
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broadcast to exchange messages with other viewers 65 
while viewing a. television broadcast. 
[0050] 'In addition, the Processor 134 can run appli- 
cations such as games via the Processor 134. The 
broadcaster is also able to provide auxiliary information 
which can allow.the viewer to play along with a game 
show being broadcast. This personalized version of the 
game would allow the viewer 65 to guess answers be- 
fore the results were revealed on the show. 
[0051] The improved TV 1 00 will also provide access ' 
to the internet to obtain supplemental information, A 
viewer 65 can send an internet request by either typing, 
the URL on the Keyboard 129 or by- using the, Menu- 
Pointer 130 to select a URL displayed on either.the Ty " 
Screen 107 orthe.TCD r Screen 127. The.Processor 13^ : 
will create a request message and, transmit it'tq the TV. 
100. The TV 100 will receive the message as described ^ 
above and will instruct the Internet interface 11 5 . to' re- ,7! 
trieve the web pages from the appropriate. Internet site. • , 
Once obtained, the "Internet Interface .115 will forward 
the pages to the^ TV Processor 112. The TV;Processor r ■ 
112 will either transmit the pages'to the f CD j 20. for ^' 
output or will display them on the TV Screen AQ%, The 
processes for retrieving information from the Jnte met 
are we 1 1, known.* 1 * ' 
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Claims 



1 . A television companion device (TCD) comprising:. ' ^ \ ,13. 

a communication receiver capable of. receiving" " 
a signal from a television set, the signal having'. /' "~ 
■ ojrie or'more types^qf infornriation spiitf rbnrv a . ' ; „' 
broadcast signal received by t the television set* '35 ' 14 

and ;\ \ ' *; " ' J /.\ _ 'j'/^ 'V '* ']['.' 

an output that presents one or more "segments, T M . ... 
of bne or more of trie types of information^ 



A device, as in claim 5, where the output is different 
than a TV output on the TV. 

A device, as in claim 5, further comprising a selector' 
input that controls the selector. 

A device, as in claim 5,. where the selector selects 
one or more of the segments based on one or more 
addresses received .with the signal. 

A device, as in any preceding claim, further com- . 
prising a .demultiplexer that demuttiplexs one or. 
more of the segments from the. signal. . ••.»•■; 

A device, as in.eJaim .Q, that demultiplexes one or 
more- of. the segments based; on 1 one ' or more ad- 
dresses. ^eceiviBd/ with the'.sjgnal. . . ■ . a r- .''<■■ .3 - 

A devicecas ; ;in -any. prec^ 
ctypes of infqrnriatipn r inctude:aay.one brrnore;ofthe. 
following: a yidep channeh^an audio channel, a data * 
channel, one qrsmore.graphical images-arid one or : 
more^anim.ated images. , . ; 3 • . ■- * • , j ; .- : f ■ , . 

A device, as in any preceding claim, where the seg- < 
ments .include any one .or more :of. the following: ah 
audio clip, ,- a yideo ; . segment,^ still; image.OaiicUa 

stream.of'text.v ■ :< L~~'.z.\ ::r 

A device K as in any preceding claim, ^vhere.the con> . : 
munication, link is any one or more of the .following: * 
an infra- red link, . - , • . f>r- : l 
a radio Jin k, a fibre, optic link,- and a coaxial, link..: ■ - 

A deyipe, as in any preceding claim, where the out- 
put includes any orvo or more of the JpHowing: a vid- 
eo output^an audio outpiit, and a text output.. 



3. 



A device, as in clairri' i , further comprising an input 
that sends one or more messages th rough' th acorn-, 
munication transceiver to t, ne television. 7- ' „ \ "... 

A device; as in claim 2, where the messages.are 
any one or more of the following: a request for a 
control for a TV selector, a request for a web brows- " 
er request, a request to a web browser to visit a^web 
site, and an acknowledgment. ; 

A device, as 'in any preceding claim, further com- 
prising an input that sends one or more messages' 
through the communication transmitter to another 
TCD. '• " - : ** ,v : - : '. 

A device, as in' any preceding claim, furtlper'cpm-. 
prising a selector that seledts one or more of the " 
segments to' be presented 6n the output. ' V " ! 



....40... 



45 



15. A television cpmpanjon device, (TCD) comprising: 

, . acomrnuriieation interface capable.of receiving 
a signal. frpma television set, the signal having 
one or more typ>es r of. information; 
a seleptor that- seiepts- one or more segments, 
frc-rp onaor more Joy he types of information; 
and ■ ^ ...... , . . ; . !. ; 

an output that presents one or more of the seg- 
ments. ... 



16. 



.17. 



55. 



A device, as in claim 15, further comprising a de- ; 
multiplexor that demultiplexes the signal into one or 
more of the types, of informatipn.. 

A device^ as jn claims 5,,where the selector further 
comprising:. a ; .Profile - Subsystem twhich contains a 
profile^of .profile, items in a database of information, 
of interest to a .yietwer- and whjich will control selec-. 
tion of 1 orje pr-mor^.c<the;segments if the segments. 
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contain one or more profile items. 

18. . A device, as in claim 17, further comprising a Proc- 
essor Subsystem having one or more processors 

which process any one or more of the following seg- 'S ^ > 

ments before selecting the segments: a video seg- . , ;_"\"v -~ r " : " 
ment, an audio segment and data segment. * * " * ** \ * : 

19. A device, as in claim 18, where one or more audio . 

segments are processed by using speech recogni- .10 •/ - ; ^ " ^ 
tion to generate a searchable transcript for key word -■■ " 
searching. 

20. A device, as in claim 1 8, that uses audio processing 

to determine the type of audio including any one or is 
more of the following: speech, music, noise and 
sounds and using; speaker identification processing 
to determine the identity^of a particular speaker. 

\ !Tv J*** — 

21. A device, as in claim 17/where Gne^r.dnQ^.yi^eo"" 20 ; » 

segments are processo'cj^y 'U^Tngnmage process- J \ f :> :r 

ing to identify a searcn^blu^ ' J 

" tion, or event. > V- 4 Y?' V'rVli '. ^ • ' * 

• H \: : -;xr^-*:v- ; J . ; . ■ ■ : \ 

22. A device, as in claim 17,-. where 01 \<&-ox "more data 25 \ ■ 

segments are prdcessed : by using text'processing I \ i - 

to generate a searchable hit list of 'one or more s — < ^ 

words. C ; ' ; ■ •* w . ^ ~ 

*. "... ' >-".' . • • ^ 

23. A device, as inclajm 18, where the Processor Sub-_ ; 
system generates identifiers trom the processed ,* s 
segments, the idehtifiers being used by the Profile;;, t 
Subsystem to control the selection. . \ - — 

24. A device, as in claim 1 8, where the Processor Sub- . 
system generates; identifiers from the processed 

"-. segments, the identifiers "tfeihgused to notify a user 
of the existence of one or more of the segments. 

26. A device, as in claim 15, where the selector has a 40 
selector input that is any one or more of the follow- 
ing: mouse, keyboard, screen, and pointer. - 
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